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Abstract. - We investigate numerically disorder chaos in spin glasses, i.e. the sensitivity of 
the ground state to small changes of the random couplings. Our study focuses on the Edwards- 
Anderson model in d = 1,2,3 and in mean-field. We find that in all cases, simple scaling 
laws, involving the size of the system and the strength of the perturbation, are obeyed. We 
characterize in detail the distribution of overlap between ground states and the geometrical 
properties of flipped spin clusters in both the weak and strong chaos regime. The possible 
relevance of these results to temperature chaos is discussed. 



One of the most spectacular theoretical prediction about the glassy phase of disordered 
systems is its generic fragility to perturbations, in particular to temperature changes. 'Temper- 
ature Chaos' (TC), i.e, the chaotic change of the thermodynamically dominant configurations 
when temperature is slightly modified, has been first proposed in the context of the scaling 
theory of spin-glasses [1-4], and later extended to other disordered systems, such as pinned 
elastic objects [5]. Although the theoretical situation is well established in the latter, simpler 
case [6-8], the very existence of TC in 3d spin glasses is still a subject of controversy [9-12], in 
particular because it has never been directly observed in (static or dynamic) simulations. It is 
nevertheless an extremely acute issue, since TC could be relevant to interpret the spectacular 
rejuvenation and memory effects experimentally observed in spin-glasses [13-15] and in a host 
of other materials as well. Arguments for and against the relevance of TC scenario have been 
put forward in [16-21]. One reason for the long standing debate is that if TC occurs at all 
in spin-glasses, it does so on very large length scales, much larger than those accessible to 
present computers [10, 11]. However, it has been argued that TC can manifest itself even on 
small length scales, but only for rare regions of space [6]. This weak chaos regime has in fact 
been argued to account in a quantitative way for experimental results [20] . It is therefore par- 
ticularly important to clarify the chaotic behavior of spin glasses in that regime. Our strategy 
is to study a similar, but much stronger effect [22]: the chaotic dependence of the spin-glass 
ground state when the couplings between the spins are slightly modified. This is referred to 
as disorder chaos (DC). Renormalization group arguments suggest that the two effects are 
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in fact deeply related and characterized by the same universal scaling function [3,5-7]; only 
prefactors differ, to make the chaos length scale much larger in the TC case. In this letter, we 
follow early studies in 2d [23,24], and study numerically DC (at zero temperature) in finite 
dimensional and mean field spin-glasses. A precise characterization of both weak and strong 
chaos regime is obtained, even using moderately small system sizes. We discuss in detail 
the geometrical aspects of DC, and show that the predictions of the scaling theory are in 
agreement with our numerical results, although some of the assumptions of the droplet theory 
must probably be revised, a conclusion already advocated in previous papers [25,26]. If TC in 
spin-glasses is indeed in the same universality class as DC, our results could shed light on the 
physics at play when the temperature is slightly changed in experiments. They also provide 
a useful guide to interpret numerical simulations on temperature chaos, which appear to be 
confined to the weak chaos regime. 

Models and observables. - We work with the Edwards- Anderson {EA) Hamiltonian 

H = ^^JijSiSj (1) 

in finite dimension = 2 and d = 'i with N = L'^ Ising spins, and use periodic boundary 
conditions. We also study Ising spin glasses on a random graph (or Bethe Lattice) of fixed 
connectivity 2; = 3. This system is known to behave like mean field models [27] and in 
particular to display Replica Symmetry Breaking [28]. In order to study disorder chaos, we 
consider two copies of the system {S^}, {5*^} and we modify the couphngs Jy in copy 2 as: 

T . t' — + XjjAJ 

where Gaussian random variable with zero mean and unit variance. With this defi- 

nition, the original and the modified couplings share the same distribution. We compute the 
ground states of both systems using an optimization method called the Genetic Renormaliza- 
tion Algorithm [29] . We were able to compute 2000 instances for diflferent A Js up to i = 60 
in 2d, L = 10 in id and N = 448 on random graphs. We will concentrate our analysis on the 
following observables: 

N N 

q=\j2slS! and C{r,L)=J2slSl,SfSf+,, (3) 



i=0 



i=0 



where q is the absolute value of the spin overlap between replicas and C is the four-point, 
two-replicas correlation function. The correlation function C therefore measures the similarity 
between the relative orientation of spins a distance r apart in the original and perturbed 
system. We will consider quantities averaged over disorder: {C{r,L)) and {q{L)), as well as 
the distribution of overlaps Pl.ajW)- 

Scaling predictions. - Following the early arguments of Bray and Moore [3], one can 
derive several scaling predictions. Consider the original system with unperturbed bonds; its 
ground state configuration(s) arc Ci (and — Ci). According to the droplet theory, the low 
lying excitations are obtained by fiipping connected, compact clusters of spins (droplets). A 
droplet of size £ has a fractal surface of dimension ds < d, and its excitation energy E > is 
distributed as PiE,£) =- i''^ piEfr'^), where p{x) is a scaling function assumed to be non zero 
at a; = and which decays to zero for large x. The energy exponent 9 is argued on general 
grounds to be such that < ^ < ds/2. Such a scaling law means that typical droplets of 
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size £ have an energy that grows as I , but that it is stiU possible to find rare excitations of 
size I with energy 0(1). The probabihty to find such excitations however decays with £ as 
. Consider now a droplet of size I in this system, corresponding to a configuration C2. 
When the bonds are changed the excess energy of the droplet also changes. Obviously, this 
energy comes only from the bonds that differs in Ci and C2, and therefore only from the bonds 
which are on the surface of the droplet, the number of which is oc f*". The contribution to 
the energy of a random perturbation of 0(A J) is thus the sum of oc i'^' independent random 
variables with random signs, i.e. a term of order ±A J£'*=/^ If the energy gained by C2 is 
larger than its original excitation energy then C2 becomes the new ground state of the 
system. If 6' < ds/2, this surely happens for large enough droplets, beyond the overlap length 
defined as: 

4(AJ) = ^jj^ with e-y-^. (4) 

When considering a system-size droplet (i.e. £ — L), this argument suggests that the overlap 
in Eq.® obeys the following scaling law: 

(9(A J, L)) = F{Lm - F(A Ji/«L), (5) 

where Fix) is a certain scaling function that we now discuss in both the strong and weak 
chaos limit. For small sizes or for small AJs, such that L <^ £c, the perturbation induced 
by the change in couplings is quite small so that typical droplets do not flip. However, 
there is still a non zero probability to find a large excitation with exceptionally low excess 
energy [6,14]. The probability to find a rare droplet of size L, with an energy less than A JL''^/^ 

is p(AJ,L) cx L-^ C''^"''^ p{EL~^)dE - p{0)AJL^ (if p(0) is finite). If the ground state 
of the perturbed sample has oc L"^ spins flipped with respect to Ci with probability p, then 
1 — (q) oc p{0)AJL^ in the weak chaos limit. In the opposite regime (large size or large AJ), 
where L 3> £c, Ci and C2 should become almost independent at scales larger than £c, and 
the residual overlap should be of order {£c/LY^^. Therefore, one expects: F{x) « 1 — ax^ 
for a; <C 1 and F{x) ~ hjx'^l'^ for a; ^ 1, where a and h are constants of order unity. This 
argument, as we show below, can in fact be generalized to estimate the full distribution of 
overlap Pl,aj{q), and not only its mean value. 

Numerical data. - Before turning to a numerical test of these predictions, we first review 
existing results on DC. The Id chain can be exactly solved [3] , and the 2d model was extensively 
studied by numerical simulations [23,24]. In both cases, Eq.lO) is obeyed. There also exist 
very convincing Monte Carlo studies in M for both T — Tc and T < Tc [22]: these again show 
that DC is well described by Eq.©. There are however no test in 3d nor in mean field (MF), 
nor systematic investigation of the shape of the scaling function F{x). Furthermore, nothing 
is known about the shape of P{q). We show our results for (q) in Fig. ^for 2d, 3d and MF. 
The scaling relations Q works perfectly in all three cases, including MF. The values found 
for ^ are also in good agreement with known results for and ds in the three models. In 
particular: 1) It is widely accepted that the 2d model is described by the droplet theory with 
9 w —0.29 and ds « 1.3 [30], which agree very well with the value ^ = 1 that gives the best 
collapse of our data in Fig. ^ 2) Mean field systems can also, in some sense, be described 
by a droplet theory with d = dg and = [31], so that, using N — L"^, the scaling variable 
becomes AJ^/N. This is also working very well, demonstrating that, although the structure 
of mean field models is very complex [28] , simple scaling arguments are sometimes enough to 
understand its behavior [10, 31] (note that our definition ^ slightly differs in mean field and 
finite dimensional systems). 3) In 3d, the best collapse is obtained for ^ « 1.3. The standard 
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Fig. 1 - Overlap {q(AJ, L)) versus LAJ^^^ = L/£c in the 2d and 3d EA (top left and right) models 
and, for a random regular graph of connectivity z = 3, as a function of NAJ^^^ (bottom left). We 
find, as expected, {q) oc y/lT/N in the strong chaos regime and 1 — (g) oc AJL^ in the weak chaos 
regime (see insets). Bottom right: Restricted overlap (Eq.llSJ) for all models. 



droplet theory however gives 9 « 0.2 and ds ~ 2.6, which would lead to ^dr ~ l-l- Mean-field 
theory, on the other hand, predicts 6 — and dg ~ d ~ 3 so that ^m/ = 1.5. Both theories 
fail to reproduce the value of ^ favored by our data (at least for the small sizes we are able 
to deal with). However, for these small lattice sizes, the 3d EA model is best described by 
an intermediate, so-called TNT scenario [25], where 6^0 [25,26] and dg w 2.6 [25]. This 
is perfectly consistent with the value f « 1.3 found in Fig. Fig. ^also shows, in various 
insets, that the asymptotic behavior of F{x) surmised above is correct. 

Overlap distribution, weak and strong chaos regime. - We would like to go beyond the 
analysis of the average overlap to get an understanding of the distribution of events and their 
geometry. It is particularly important to study directly the weak chaos limit since two scenarios 
are in principle possible: either a small perturbation typically causes a small rearrangement, 
i.e., with probability of order unity, 0{AJL^) spins flip; or a small perturbation typically leads 
to no rearrangement at all, except in rare cases, where if flips 0{L'^) spins with probability 
0{AJL^). A useful quantity to consider in numerical work is the following restricted average 
overlap, where we exclude the samples where almost no change is induced: 

, . _ /o° %P(g)dg 

W)«<0.9 - ^0.9 p. . , ■ W 

Jo P{q)dq 
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Fig. 2 - The overlap distribution P{q) between ground states in 2d (left) and 3d (right) systems for 
large size. In inset, Q{x) = P{r)dr, where r = 1-g for AJ = 10"^(2d) and AJ = 10"^(3d). Q{x) 
behaves quite differently from the droplet theory prediction Q{x) oc x^^^ , with ^ = 1 — ^/d. 



If P{q) is peaked around its average value, {q)q<co.9 should be close to 0.9 for small AJL^, and 
progressively decrease away from that value. If on the other hand, rare events are dominant, 
{Q)q<o.9 should be significantly smaller than 0.9 and constant as long as AJL^ is less than 
unity. Furthermore, if rare events induce a complete reshuffling of the spin configuration, as 
was conjectured in [14], then {q)q<a.g ~ 0. Fig. ^ (bottom right) unambiguously shows that 
the second scenario holds: in the weak chaos limit, (q)g<o.9 is found to be constant for AJL^ 
small, and close to 0.57, very different both from 0.9 and from 0. The full distribution P{q) 
is plotted in Fig. |2]for different values of AJ. It is clear that, although for infinitesimal chaos 
almost all samples lead to q = 1 and for large chaos to q = 0, the distribution in the weak 
chaos regime is not simply a two-peak function with weight around q = and q = 1. This 
means that in the rare cases where the perturbation is relevant, the new ground state typically 
retains a significant "backbone" of the previous ground state. This is illustrated by the Id 
chain case. In the weak chaos limit, only the weakest bond is broken by the perturbation, so 
the overlap q is uniformly distributed in [0, 1] (in which case {q)q<^o.9 — 0.45, see Fig. For 
d > 1, a droplet like argument predicts P{q) as follows: assume that droplets of size £ and 
£/b can be considered as independent for some 6 > 1, and denote r — 1 ~ q the fraction of 
flipped spins. Deflning P{r,L) as P{r,L) without the 5{r) part, one can establish a recursion 
equation of the form: P{r,L) = p[f{r) + b'^^^P{b'^r, L/b)], where / is a regular function. 
From this, one deduces that P{r,L) must behave as r~^, with fj, — 1 — ^/d. Using the values 
of ^ reported above, we find /x = in d = 1 (which is the exact result), and fi w 0.5 for 
d = 2, 3 and MF. This prediction is however not in agreement with our numerical data (see 
Fig. 121 insets), which rather suggests /x « 1, i.e. a stronger divergence of P{r,L) at small 
r. Our data therefore suggests an excess number of small droplets compared to large ones, 
possibly related to the findings of [26], where fractal low energy clusters (corresponding to 
small r's) were identified. Along these lines, it is interesting to compare the system size clusters 
generated in the weak chaos regime to those obtained using totally different and more specific 
methods [25]. Studying the geometrical properties of the weak chaos droplets, we computed 
directly the interface fractal dimension dg and found, as expected, that ds{2d) « 1.3 and 
ds{3d) « 2.6. We also studied the topological properties of excitations in 3d and found that 
most of them are spongy, winding around the lattice. Therefore, the clusters that are fiipped 
in the weak chaos regime are similar to the large-scale low energy excitations obtained in [25] . 
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Fig. 3 - Left: Correlation function for size L = 10 to L = 60 in the 2d EA model for different value of 
the disorder rescaled according to Eq.(|7J. Inset: 3d data. Right: Collapse of the data using Eq.l|HJ; 
the full line is (L/lc)^ (again 3d in the inset). 



Correlation functions. - The numerical study of the behavior of spatial correlation func- 
tion between the two ground states is made difficult because there are now three relevant 
lengths in the problem: L, r and £c so that C(r, A J, L) may have non trivial finite size effects 
(see for instance [23] for 2d data). However, we will show that the most important features 
of the correlation function can still be fairly well understood. Scaling arguments suggest that 
the following form should hold: 

Cir,AJ,L)^c[L^y (7) 

Our data in Fig. |31is perfectly compatible with this scaling. Given this success, one would 
like to go beyond Eq. lO and propose a specific form for C. A factorized form does not seem 
to hold; rather, we found that the following form leads to a satisfactory collapse of our data 
both in the weak and strong chaos regimes (see Fig. EJ: 



C(u,w)«exp- [^t-«(l-e-^"')] , (8) 



where A and B are fitting constant. In the limit L — )■ oo, u — > and C becomes a function of 
w — r/£c only, of the form exp —ABw^ , which fits well the data, in particular in the weak chaos 
regime where it predicts that 1 — C(r) oc r^AJ as expected from the above arguments applied 
to droplets of size r. In the long distance regime, this form of C suggests a super-exponential 
decay of the correlation, in agreement with the results on Migdal-Kadanoff lattices [32]. 

Conclusion. - We have studied numerically disorder chaos in different Ising spin glass 
models finding that, although the Id and 2d models have a spin glass phase only at T = 0, 
the 3d model has a finite temperature transition and the mean field model is described by a 
complex hierarchy of states, DC could be understood in term of simple droplet-like scaling 
laws. In particular, we find that the weak chaos regime is dominated by rare events where large 
droplets are overturned, as conjectured in [6,14,20], with however an anomalous proliferation 
of small droplets. We also find once again strong indications that the droplets are not compact 
objects. Our study provides precise predictions that can be tested even on small spin-glass 
samples, to check whether temperature chaos is or not in the same universality class as DC. 
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It would be particularly interesting to reanalyze in this spirit the existing data of [9] for 3d 
and mean field models. If the same scaling functions are obtained, this would constitute 
compelling evidence for the presence of a chaotic temperature dependence in spin glasses. It 
is however possible that more complicated scenarii hold, for example temperature chaos but 
with continuously varying exponents. As far as experiments are concerned, our finding of a 
proliferation of small overturned droplets could play an important role in the quantitative 
interpretation of rejuvenation and memory effects in spin-glasses. 

* * * 

We thank L. Berthier, T. Jorg, O. Martin, M. Sasaki, R. da Silveira, E. Vincent, O. White 
and H. Yoshino for discussions on these issues. 
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